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DETAILED ACTION 



Response to Amendment 



1 . Applicant's amendment filed on June 08, 2006 has been entered in full. 

2. Applicant's arguments with respect to the claims as presented in the amendment filed have 
been fully considered but are not persuasive. 



Response to Arguments 

3. Applicant's arguments regarding the prior art rejections under Adelson, Ohki, Frost, Kubota, 
and Palmquist on pages 2-7 of the Amendment filed on June 08, 2006, have been fully considered 
but are not persuasive. 

4. Applicant, in various paragraphs (page 2, 3 rd and 4 th paragraphs; page 3, 3 rd paragraph), in 
whole, argues in substance: 

a. The pixel sample sets are not defined regions corresponding to a location on the 
object - but instead they are merely computed regions in an image that have no association 
with the object whatsoever. The pixel sample sets that are derived from an analysis of the N 
frequency analysis, as disclosed by Adelson, have no association with the object. 

Examiner respectfully disagrees. As disclosed before in the previous rejection, Adelson's 
invention relates to generating a single improved focused image of an object (here a 3D microscope 
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specimen) by obtaining a plurality of separately focused images of different optical sections of a 3D 
microscope specimen (object) (col. 1, lines 4-16; col. 6, lines 41-45) which further conforms to the 
claim 6's limitation "providing a plurality of images of the object, each image having a focus setting". 
Clearly from the above disclosure, Adelson, takes images of different optical sections of a 
microscope specimen (object) and images of different optical sections are apparendy the images of 
the locations on the object. Now if one of ordinary skill in the art divides each image that 
corresponds to each optical section (location) on the object into various image regions for analysis, 
these image regions will still point to the same spatial information on the object as recited into the 
main image. 

Applicant argues in substance that "pixel sample sets are not defined regions corresponding 
to a location on the object but instead they are merely computed regions in an image that have no 
association with the object whatsoever". Examiner here directs applicant to the definition of an 
image here, which is "image is nothing but a collection of pixels and the visual information is 
defined by the pixels of which an image is composed of. The claim itself recites defining a plurality 
of image regions on the image itself, where each image region being sample set of pixels. 

Further, considering the limitation "defining a plurality of image regions, each of the 
plurality of image regions corresponding to a location on the object". This limitation recites two 
parts, (a) defining a plurality of image regions, and (b) each of the plurality of image regions 
corresponding to a location on the object. Clearly part (a) just recites "defining a plurality of image 
regions" and nowhere teaches "defining a plurality of image regions according to a location on the 
object". Adelson clearly teaches defining a plurality of image regions in the each image based 
on the spatial information (here spatial frequency bands). Part (b) simply recites "each of the 
plurality of image regions corresponds to a location on the object" and Adelson as disclosed before, 
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takes images of different optical sections of a microscope specimen (object) and images of different 
optical sections are apparently the images of the locations on the object and if one of ordinary skill 
in the art divides each image that corresponds to each optical section (location) on the object into 
various image regions for analysis, these image regions will still point to the same spatial information 
on the object as recited into the main image. Further adding for the sake of arguments, in Adelson if 
each of the plurality of the image portions did not correspond to a location (spatial information) on 
the object (as said by applicant in the arguments), it wouldn't be possible for Adelson to obtain a 
single focused image of that particular object and there would be no reason for Adelson to use such 
image regions, and Adelson's invention would have no meaning then. Examiner has rejected the 
limitations as they are recited in the claims and therefore office still maintains the rejections on the 
respective claims. All other arguments are moot in view of the rejections made before in the 
previous office action and therefore the rejections still stand. 

Claim Rejections - 35 USC § 103 

5. The following is a quotation of 35 U.S.C 103(a) which forms the basis for all obviousness 

rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in section 
102 of this tide, if the differences between the subject matter sought to be patented and the prior art are such that the 
subject matter as a whole would have been obvious at the time the invention was made to a person having ordinary 
skill in the art to which said subject matter pertains. Patentability shall not be negatived by the manner in which the 
invention was made. 

6. Claims 6 and 17 are rejected under 35 U.S.C. 103(a) as being unpatentable over Adelson, 
U.S. Patent No. 4,661,986 and further in view of Ohki, U.S. Patent No. 6,831,694. 
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Claim 6 recites "a method for generating a focused image of an object from an optical 
imaging system, the method comprising: providing a plurality of images of the object, each 
image having a focus setting; defining a plurality of image regions, each of the plurality of 
image regions corresponding to a location on the object". Adelson discloses "This invention 
relates to an image-processing method and, more particularly, to an image-processing method for 
deriving a single improved-focus two-dimensional for deriving a single improved-focus 2D image of 
a 3D scene from a plurality of separately-focused 2-D images of this 3-D scene. The term "scene", 
as used herein, means a particular region of 3-D space including ail objects situated within that 
particular region (col. 1, lines 5-16) where it is clear from the above disclosure that 3-D scene can be 
an object Adelson further discloses "As indicated in figure 1, the image processing method of the 
present invention operates on M separately focused two-dimensional images of the same 3-D 
scene Each of separately-focused images 100-1... .100-M can be either in sampled or non- 
sampled analog form, or, alternatively, in sampled digital form separate images 100-1. ..100-M of 

the fixed scene can be made successfully at different times with the same lensing system adjusted at 
each of these to a different focus" (col. 4, lines 4-16). Adelson further discloses the application of 
such invention by disclosing "while the second of these application relates to use of a television 
microscope for successively obtaining a series of separately focused 2-D images of different optical 
sections of a 3-D microscope specimen (object) being observed" (col. 6, lines 41-45). Adelson 
further discloses defining a plurality of image regions (pixel sample sets) based on the spatial 
frequency bands where apparendy each of the plurality of image regions corresponds to a location 
on the object when images are take of the specimen (or object) (Figure 1; col. 4, lines 39-56; col. 4, 
lines 67-68 through col. 5, lines 1-10; col. 5, lines 25-40). 
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Claim 6 further recites "measuring a sharpness score for each image region of at least two of 
the plurality of images; determining a spatial weighting for the image regions using the sharpness 
score; and computing a composite image of the object by combining each of the plurality of images 
using spatial weighting". A person using a camera or microscope can determine the optimal or sharp 
focus by looking at the focused image and then based on his/her capability of viewing image 
appropriate sharpness or focusing can be selected. But the same problem of obtaining a focused 
image using an image processing system or a computer system is totally different. A computer 
system cannot determine the optimal or sharp focus by just looking at the focused image as done by 
a human operator, but it has to perform some calculations or weighting on the images by 
considering image characteristics such as measuring high frequency components in an image which 
is well-known to determine the best focus and Adelson teaches the same where the spatial frequency 
spectrum (sharpness) of the image regions of the plurality of images are analyzed, the regions further 
are classified into different spatial frequency bands and further the regions with desired focus with 
respect to the frequency spectrum associated are selected according to the focus desired (col. 4, lines 
25-68; col. 5, lines 25-40, lines 54-68; col. 6, lines 7-14, line 22-31) and further clearly teaches 
selecting the highest score region (image region with best focus) to obtain a focused image and 
combining the images (col. 5, lines 54-67, col. 6, lines 22-31; col. 8, lines 5-8). Also, Adelson in the 
background of the invention discloses "A three-dimesnsional image processing technique is 
described that permits a 3D display to be produced by digitizing the specimen with the focal pane 
situated at various levels along the optical axis and then processing each resulting image to remove 
the defocused information from structures in neighboring planes. This approach makes it possible 
to roughly separate each section image into 2 components - a sharp component of objects in the 
plane of focus, and a blurred component contributed by objects lying in the other planes. By 
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extracting the sharp components and stacking them up, a 3D microscope scene can be 
displayed with a significant increase in the depth of field (col. 1, lines 50-65). It is apparent from the 
above disclosure that Adelson picks the image samples having the best focus where assigning the 
best focus to the image sample using sharpness score is spatial weighting of the image 
sample done by the system, and when computing a composite image, the image samples selected 
using spatial weighting are combined which gives the total maximum sharpness score of the image. 
Adelson does not specifically teach the claimed specific term of determining spatial weighting as part 
of the focus determination. Spatial weighting of the image based on the sharpness score is well 
known technique to determine a best focused image, and this well known spatial weighting specifics 
are further taught by Ohki, to further provide the support to this well known technique. 

Ohki discloses an image processing apparatus, method and storage for creating a sharply 
focused image by the use of a plurality of images having different degrees focus setting (col. 1, lines 
5-15) and further discloses computing a composite image of the object by combining each of the 
plurality of images using the spatial weighting (col. 1, lines 30-68 through col. 2, lines 1-20; col. 10, 
lines 35-67; col. 11, lines 25-60; col. 13, lines 1-35). Therefore, it would have been obvious for one 
of ordinary skill in the art at the time of invention was made to use the teachings of computing a 
composite image of the object by combining each of the plurality of images using the spatial 
weighting as taught by Ohki in the invention of Adelson because both the references are directed to 
the same field of endeavor and solve the same problem of obtaining the focused image of the object 
and Ohki further teaches that using such as method would permit creation of sharply-focused 
images at low cost (See Okhi, col. 14, lines 43-45). 
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Claim 17 recites "the method of claim 6 wherein the fine feature sharpness measurement 
further comprises: transforming the at least one region of the image so as to provide a plurality of 
spatial frequencies of the at least one region of the image; measuring a density of high spatial 
frequencies; and using the density of high spatial frequencies so as to provide a fine feature 
sharpness measurement". The claim 17 limitations are very well known to be performed in the art of 
image processing to obtain sharpness score of the image to obtain focused image. It is well known 
in the art that higher frequency component represent the image sharpness (higher the high 
frequency components, the sharper is the image) and this well known fact has been used in creating 
focused image of the object. As discussed in rejection of claim 6, Adelson clearly discloses the 
analysis of the spatial frequency spectrum of the image where the highest frequency band image 
samples from different images are selected and combined to form a focused image. Also, the same 
has been disclosed by Ohki (col. 11, lines 53-60). 

7. Claims 6, 7, 12-14 and 18 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Adelson, U.S. Patent No. 4,661,986 and further in view of Frost et al, U.S. Patent No. 5,647,025. 

Claim 6 recites "a method for generating a focused image of an object from an optical 
imaging system, the method comprising: providing a plurality of images of the object, each 
image having a focus setting; defining a plurality of image regions, each of the plurality of 
image regions corresponding to a location on the object". Adelson discloses "This invention 
relates to an image-processing method and, more particularly, to an image-processing method for 
deriving a single improved-focus two-dimensional for deriving a single improved-focus 2D image of 
a 3D scene from a plurality of separately-focused 2-D images of this 3-D scene. The term "scene", 
as used herein, means a particular region of 3-D space including all objects situated within that 
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particular region (col. 1, lines 5-16) where it is clear from the above disclosure that 3-D scene can be 
an object. Adelson further discloses "As indicated in figure 1, the image processing method of the 
present invention operates on M separately focused two-dimensional images of the same 3-D 
scene Each of separately-focused images 100-1 .. ..100-M can be either in sampled or non- 
sampled analog form, or, alternatively, in sampled digital form separate images 100-1.. . 100-M of 

the fixed scene can be made successfully at different times with the same lensing system adjusted at 
each of these to a different focus" (col. 4, lines 4-16). Adelson further discloses the application of 
such invention by disclosing "while the second of these application relates to use of a television 
microscope for successively obtaining a series of separately focused 2-D images of different optical 
sections of a 3-D microscope specimen (object) being observed" (col. 6, lines 41-45). Adelson 
further discloses defining a plurality of image regions where apparendy each of the plurality of image 
regions corresponds to a location on the object when images are take of the specimen (or object) 
(Figure 1; col. 4, lines 39-56; col 4, lines 67-68 through col. 5, lines 1-10; col. 5, lines 25-40). 

Claim 6 further recites "measuring a sharpness score for each image region of at least two of 
the plurality of images; determining a spatial weighting for the image regions using the sharpness 
score; and computing a composite image of the object by combining each of the plurality of images 
using spatial weighting". A person using a camera or microscope can determine the optimal or sharp 
focus by looking at the focused image and then based on his/her capability of viewing image 
appropriate sharpness or focusing can be selected. But the same problem of obtaining a focused 
image using an image processing system or a computer system is totally different A computer 
system cannot determine the optimal or sharp focus by just looking at the focused image as done by 
a human operator, but it has to perform some calculations or weighting on the images by 
considering image characteristics such as measuring high frequency components in an image which 
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is well-known to determine the best focus and Adelson teaches the same where the spatial frequency 
spectrum (sharpness) of the image regions of the plurality of images are analyzed, the regions further 
are classified into different spatial frequency bands and further the regions with desired focus with 
respect to the frequency spectrum associated are selected according to the focus desired (col. 4, lines 
25-68; col. 5, lines 25-40, lines 54-68; col. 6, lines 7-14, line 22-31) and further clearly teaches 
selecting the highest score region (image region with best focus) to obtain a focused image and 
combining the images (col. 5, lines 54-67, col 6, lines 22-31; col. 8, lines 5-8). Also, Adelson in the 
background of the invention discloses "A three-dimesnsional image processing technique is 
described that permits a 3D display to be produced by digitizing the specimen with the focal pane 
situated at various levels along the optical axis and then processing each resulting image to remove 
the defocused information from structures in neighboring planes. This approach makes it possible 
to roughly separate each section image into 2 components - a sharp component of objects in the 
plane of focus, and a blurred component contributed by objects lying in the other planes. By 
extracting the sharp components and stacking them up, a 3D microscope scene can be 
displayed with a significant increase in the depth of field (col. 1, lines 50-65). It is apparent from the 
above disclosure that Adelson picks the image samples having the best focus where assigning the 
best focus to the image sample using sharpness score is spatial weighting of the image 
sample done by the system, and when computing a composite image, the image samples selected 
using spatial weighting are combined which gives the total maximum sharpness score of the image. 
Adelson does not specifically teach the claimed specific term of determining spatial weighting as part 
of the focus determination. Spatial weighting of the image based on the sharpness score is well 
known technique to determine a best focused image, and this well known spatial weighting specifics 
are further taught by Frost, to further provide the support to this well known technique. Frost 
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determines a sharpness score and uses the sharpness score to determine the spatial weighting and 
further determines the optimal focus of the image regions using the spatial weighting (col. 8, lines 5- 
67). Frost further discloses combining of all successful focused scans to generate a model of the 
focused surface of the object to obtain an optimal focus setting to attain an optimal focused image 
(col. 14, lines 40-47). It is apparent from the above disclosure that it would be obvious for one of 
ordinary skill in the art to first obtain an optimal focus setting to obtain an optimal focused image. 
Therefore, it would have been obvious to one having the ordinary skill in the art at the time of the 
invention was made, to use the teachings of determining spatial weighting using sharpness score as 
taught by Frost for defining the claimed specifics of obtaining the optimal focused image in the 
invention of Adelson. One would have been motivated to use the teachings of determining spatial 
weighting using sharpness score as taught by Frost for defining the claimed specifics of obtaining 
the optimal focused image in the invention of Adelson because both references are directed to 
obtaining optimal focused image and Frost further provides the specifics of obtaining optimal 
focused image based on spatial weighting of which Adelson does not provide the specifics. Frost 
provides a method for automatically focusing on biological specimens (same as Adelson), and more 
particularly to a microscope auto-focus system which automatically focuses on features, patterns, or 
specific types of objects to automatically identify objects of interest from a set of images collected 
from different focal depths and automatically selects the focal depth which corresponds to best 
focus on the objects of interests (col. 2, lines 1-5). Both references are based on the same principle 
of auto focusing to determine the best focus of the image and therefore it would have been obvious 
to one of ordinary skill in the art to combine both references for better detailed specifics of 
generating a focused image. Further, Frost provides a process to bring into best focus only the 
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objects of interest without the need to focus independently on each object of interest (column 2, 
lines 11 -14). 

Claim 7 recites " the method of claim 6 wherein the step of providing at least one image 
region in at least one image further comprises: determining a set of focus regions on the surface of 
the object; and aligning at least one focus region in at least one image". All the limitations recited in 
claim 7 have been similarly analyzed and rejected as per claim 6 in view of Adelson (col. 4, lines 1- 
16; lines 25-55; col. 5, lines 25-40; col. 6, lines 52-56). Also, Frost discloses of identifying objects of 
interest from a set of images collected from different focal lengths, which satisfy the limitation 
"determining a set of focus regions on the surface of the object" (column 2, lines 1-3). Frost in 
continuation also disclose "a method to bring into best focus only the objects of interest in a full 
field of view" (column 2, lines 11-14) and " a focus measure is computed for each of the images, 
where each focus measure is a function of at least one image measurement" (column 2, lines 26-29) 
which satisfy the limitation "aligning at least one focus region in at least one image". 

Claim 12 recites "the method of claim 6 wherein the plurality of image regions comprises a 
greyscale image map". Frost discloses "a histogram is computed of the gray levels of the image" 
(column 7, lines 21-23 and lines 46-50) and it would be apparent to one of ordinary skill in the art 
that if the image is a grayscale image, different regions of image would also be grayscale images. 

Claim 13 recites " the method of claim 6 wherein the step of providing a plurality of images 
further comprises: determining a coarse focus position". Frost discloses of computing an initial 
focus scan to determine the best focus (coarse focus) position and this process continues 
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incrementally until a best focus position is achieved (column 9, lines 1-10 and lines 20-27). Each 
time the initial focus scan is performed a plurality of images are acquired (column 6, lines 11-14 
and lines 65 - 66). 

Claim 14 has been similarly analyzed and is rejected as per claim 13. 

Regarding claim 18, as discussed in the rejection of claim 6, each image has its focus 
setting and each image region, which is a part of the image if being imaged will apparently 
(inherendy) have at least one focus setting. 

8. Claims 8, 9, 10 and 11 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Adelson, U.S. Patent No. 4,661,986, further in view of Frost et al, U.S. Patent No. 5,647,025 and 
further in view of Kubota et al, IEEE Publication, 2000, "Inverse filters for reconstruction of 
arbitrarily focused images from two differently focused images". 

Regarding claims 8, 9, 10 and 11, Adelson does teach overlapping of regions (col. 4, lines 
50-53) but both Adelson and Frost fails to disclose the use of fuzzy transition such as Gaussian, 
when one image region overlaps an adjacent image region. However, in the same field of the 
invention, Kubota discloses that when at least one region (foreground) overlaps another adjacent 
region (background) the overlapping results in blurring (fuzziness) which is a Gaussian function (in 
the left column of page 2). Further, applicant has admitted in the specification (page 18, line 1- 
6) that this is well known in the art of image processing field. Therefore, it would have been 
obvious that one would have been motivated to incorporate the teaching of Kubota into the method 
of Frost for the purpose of generating an all-focused image in which both adjacent images are in 
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focus because of the conventionality of this type 
adjacent image portions to blend together and not 
because the applicant has acknowledged that this 
specification). 



Page 14 

of transition and because this will make the 
be distracting to the viewer and, additionally, 
is a well known procedure (page 18 of the 



9. Claims 15 and 16 are rejected under 35 U.S.C. 103(a) as being unpatentable over Adelson, 
U.S. Patent No. 4,661,986 and further in view of Frost et al, U.S. Patent No. 5,647,025 and in 
further view of Palmquist et al., U.S. Patent No. 5,179,419. 

Claim 15 recites "the method of claim 7 wherein the object is a fiber optic cable end face". 
Adelson does teach "the present invention is particularly suitable for use in microscopy for deriving 
an improved focus 2D image of a 3D microscope specimen" (col. 3, lines 38-40) and Frost also does 
teach obtaining focused image of a microscopic specimen. Both Adelson and Frost does not teach 
of generating a focused image of a fiber optic cable end face. However, Palmquist discloses the 
methods of detecting defects in optical fiber end faces. Palmquist same as combined invention of 
Adelson and Frost, is also directed to the determination of optimum focal position (column 3, lines 
30-40) by acquiring a plurality of images (column 6, lines 42-45) and performing a sharpness 
measurement (column 6, lines 62-65) on each of the image portions but the image portion belongs 
to a fiber optic cable end face. Palmquist same as Frost determines the coarse focus position and 
comprises of grayscale image map for each image (column 8, lines 1-4). Therefore, it would have 
been obvious for one of ordinary skill in the art at the time of invention was made to use the 
combined method of Adelson and Frost in generating a focused image of a fiber optic cable end 
face as done by Palmquist because Frost same as Adelson provide a method for automatically 
focusing on microscopic specimens, and Frost more particularly to a microscope auto-focus system 
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which automatically focuses on features, patterns, or specific types of objects to automatically 
identify objects of interest from a set of images collected from different focal depths and 
automatically selects the focal depth which corresponds to best focus on the objects of interests (col. 
2, lines 1-5). Optical fibers, as known, are very micro-sized such as biological specimens and in order 
to obtain the best-focused composite image of the optical fiber surface, a microscopic image taking 
system is required and which is provided by the combined invention of Adelson and Frost. 
Therefore, one of ordinary skill in the art would be motivated to use the combined invention of 
Adelson and Frost to obtain the best focused composite image of the optical fiber surface by the use 
spatial weighting. 

Claim 16 recites "the method of claim 15 wherein the set of regions are annular". Frost 
discloses a spiral pattern formation around the original starting focus point when determining a set 
of focus regions on the surface of the object. 

Conclusion 

10. THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE MONTHS 
from the mailing date of this action. In the event a first reply is filed within TWO MONTHS of the 
mailing date of this final action and the advisory action is not mailed until after the end of the 
THREE-MONTH shortened statutory period, then the shortened statutory period will expire on 
the date the advisory action is mailed, and any extension fee pursuant to 37 CFR 1.136(a) will be 
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calculated from the mailing date of the advisory action. In no event, however, will the statutory 
period for reply expire later than SIX MONTHS from the mailing date of this final action. 

Any inquiry concerning this communication or earlier communications from the examiner 
should be directed to Manav Seth whose telephone number is (571) 272-7456. The examiner can 
normally be reached on Monday to Friday from 8:30 am to 5:00 pm. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's supervisor, 
Bhavesh Mehta, can be reached on (571) 272-7453. The fax phone number for the organization 
where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR system, 
see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR system, 
contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 
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